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Abstract 

The sets of contexts and properties of a concept are embedded in tlie complex Hilbert space of quantum 
mechanics. States are unit vectors or density operators, and contexts and properties are orthogonal pro- 
jections. The way calculations are done in Hilbert space makes it possible to model how context influences 
the state of a concept. Moreover, a solution to the combination of concepts is proposed. Using the tensor 
product, a procedure for describing combined concepts is elaborated, providing a natural solution to the pet 
fish problem. This procedure allows the modeling of an arbitrary number of combined concepts. By way of 
example, a model for a simple sentence containing a subject, a predicate and an object, is presented. 

Keywords: concept, combination, quantum mechanics, Hilbert space, context, entanglement, pet 
fish problem, tensor product. 

1 Introduction 

The SCOP theory models a concept as an entity that can be in different states such that a state changes under 
the influence of a context. The notion of 'state of a concept' makes it possible to describe a specific contextual 
effect, namely that an exemplar of the concept has different typicalities and a property of the concept different 
applicabilities under different contexts. The experiment put forward in [7] illustrates this contextual effect. 
In this article we present a numerical mathematical model for the representation of a concept, built with 
a mathematical formalism originally used in quantum mechanics, and we show that the data of the above 
mentioned experiment can be reproduced by the model. Specifically, the model is built using the Hilbert space 
of quantum mechanics, states are represented by unit vectors of this Hilbert space and contexts and properties 
by projection operators, and the change of state under the influence of a context is described by von Neumann's 
'quantum collapse state transformation' in Hilbert space |14| . 

This article deals primarily with the question of what happens when concepts combine. As explained in 
[7] , known theories of concepts (prototype, exemplar and theory) cannot deliver a model for the description of 
the combination of concepts. We show that the standard quantum mechanical procedure for the description of 
the compound of quantum entities, i.e. the tensor product procedure, delivers a description of how concepts 
combine. Specifically, given the Hilbert spaces of individual concepts, the combination of these concepts is 

*To appear in Kybernetes, Summer 2004. 
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described by the tensor product Hilbert space of these individual Hilbert spaces, and the quantum formahsm 
apphed in this tensor product Hilbert space. In this way we work out an explicit description of the combination 
of 'pet' and 'fish' in 'pet fish', and show that our model describes the guppy effect, and as a consequence solves 
in a natural way what has come to be known as the 'pet fish problem'. 

We were amazed to find that not only combinations of concepts like 'pet fish', but also sentences like 'the 
cat eats the food' can be described in our formalism by nonproduct vectors of the tensor product (representing 
the so called entangled states of quantum mechanics) of the individual Hilbert spaces corresponding to the 
concepts in the combination. It is quantum entanglement that accounts for the most meaningful combinations 
of concepts. In the last section of the article we explain the relation between our Hilbert space model of concepts 
and von Foerster's quantum memory approach. 

2 The Mathematics for a Quantum Model 

This section introduces the mathematical structure necessary to construct a Hilbert space representation of a 
concept. 

2.1 Hilbert Space and Linear Operators 

A Hilbert space 7i is a vector space over the set of complex numbers C, in which case we call it a complex Hilbert 
space, or the set of real numbers M, in which case we call it a real Hilbert space. Thus the elements of a Hilbert 
space are vectors. We are interested in finite dimensional complex or real Hilbert spaces and hence do not give a 
definition of an abstract Hilbert space. Let us denote C" to be the set of n-tupels (xi, 0:2, . . . , a;„_i, x„), where 
each Xk for 1 < fc < n is a complex number. In a real Hilbert space, the elements Xk are real numbers, and the 
set of n-tupels is denoted R". However, we consider the complex Hilbert space case as our default, because the 
real Hilbert space case is a simplified version of it, and its mathematics follows immediately from the complex 
case. We define a sum and a multiplication with a complex number as follows: For {xi,X2, ■ ■ ■ ,Xn-i,Xn), 
(yi, 2/2, ■ • ■ , yn-i,yn) e C" and a G C, we have 

{xi,X2, ■ . .,Xn-i,Xn) + (?/i,?/2, ■ • ■,y„-i,y„) = (xi + yi,X2 + 2/2, ■ • • ,Xn-i + 2/«-i,a;„ + yn) (1) 
a{xi,X2: ■ ■ ■ ,Xn-i,x„) = {a ■ xi,a ■ X2: ■ ■ ■ ,a ■ Xn-i,a ■ x„) (2) 

This makes C" into a complex vector space. We call the n tupels (xi, X2^ ■ ■ ■ , Xn-i, Xn) vectors and denote them 
\x) G C". We also define an inproduct between vectors of C". For \x), \y) G C" we have: 

{x\y) = xj • yi + X2 • 2/2 + • • ■ + K-i ■ 2/n-i + < • 2/« (3) 

where x* is the complex conjugate of Xi. The inproduct of two vectors is a complex number, hence {x\y) € C. 
For a,/3 G C and \x), \y), \z) G C" we have 

{ax + I3y\z) ~ a* {x\z) + (3* {y\z) and {x\ay + f3z) = a{x\y) + f3{y\z) (4) 

This shows that the inproduct is conjugate linear in the first slot, and linear in the second slot of the operation 
( • I • ). The complex vector space C" equipped with this inproduct is an n dimensional complex Hilbert space. 
Any n dimensional complex Hilbert space is isomorphic to C". The inproduct gives rise to a length for vectors 
and an angle between two vectors, i.e. for |a;), \y) G C" we define 



\\x\\ = V (x\x) and cos(a;, y) = y^^||— (5) 

Two non-zero vectors \x),\y) G C" are said to be orthogonal iff (a;|y) = 0. © shows that if the inproduct 
between two non zero vectors equals zero, the angle between these vectors is 90 degrees. A linear operator A 
on C" is a function A : C" ^ C" such that 

Aia\x) + I3\y)) ^ aA\x) + l3A\y) (6) 
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For the finite dimensional Hilbert space C" each hnear operator A can be fully described by a n x n matrix 
■A-ij, l^i<n,l<j<nof complex numbers, where 

n n n n 

Mx) = ^i3^3^Yl ^2ia;j, . . . , X An-ijXj,^ An.jXj) (7) 

if |x) = {xi,X2, ■ ■ ■ ,Xn-i,Xn)- Wc makc no distinction between the linear operator A and its matrix represen- 
tation Aij. This gives us the necessary ingredients to explain how states, contexts and properties of a concept 
are represented in the Hilbert space model. 

2.2 States 

There are two types of states in quantum mechanics: pure states and density states. A pure states is represented 
by a unit vector |a;) € C", i.e. a vector jcc) S C" such that ||a;|| = 1. A density state is represented by a density 
operator p on C", which is a linear operator that is self adjoint. This means that 

Ptj = Pji (8) 

for all i,j such that I < i < n,l < j < n. Furthermore, it is semi definite, which means that > 

V |a;) G C" and its trace, which is the sum of the diagonal elements of its matrix representation, is equal to 
1. Hence ^"^i pa = 1- So, to represent the concept 'pet' and the situation described previously using this 
quantum model, we determine the dimension ri of the Hilbert space, and represent the states pi,p2, . . . ,Pn G S 
of 'pet' using unit vectors or density operators of the Hilbert space C". 

2.3 Properties and Weights 

A property in quantum mechanics is represented by means of a linear operator, which is an orthogonal projection 
operator or an orthogonal projector. An orthogonal projection operator P is also a self adjoint operator; hence 
(ISl must be satisfied, i.e., Pij = P*^. Furthermore for an orthogonal projector, it is necessary that the square 
of the operator equals the operator itself. Hence P^ — P. Expressed using the components of the matrix of P, 
this gives YTj=i PijPjk = Pik- 

This means that to describe the concept 'pet' we need to find two orthogonal projection operators Pa and 
Pb of the complex Hilbert space C" that represent the properties a,b G C. 

Let us introduce the quantum mechanical rule for calculating the weights of properties in different states. If 
the state p is a pure state represented by a unit vector \xp) g C" we have 

v{p,a) = {xp\Pa\xp) (9) 

If the state p is a density state represented by the density operator pp we have 

i^{p, a) = TrppPa (10) 

where TrpPa is the trace (the sum of the diagonal elements) of the product of operator p with operator Pa. 

2.4 Contexts, Probabilities and Change of State 

In quantum mechanics, a measurement is described by a linear operator which is a self adjoint operator, hence 
represented by an n x n matrix Mij that satisfies (jHl, i.e, Mtj = M*^. Although it is standard to represent 
a context — which in the case of physics is generally a measurement — using a self adjoint operator, we will use 
the set of orthogonal projection operators that form the spectral decomposition of this self adjoint operator, 
which is an equivalent representation. Note that we have been considering 'pieces of context' rather than total 
contexts, and a pieces of context is represented by one of these projection operators. Hence, a (piece of) context 
e is represented by a projector P^. Such a context e changes a state p of the concept to state q as follows. If p 
is a pure state represented by the unit vector \xp) € C" we have 

I- ^ - ^-^'^^^ (11) 



V {Xp\Pe\Xp) 
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where 

^J■{q,e.,p) ^ {xp\Pe\xp) (12) 

is the probabihty that this change takes place. If p is a density state represented by the density operator pp we 
have 

where 

K'l^e,p) ^TrppPe (14) 
is the probabihty that this change takes place. 

2.5 Orthonormal Bases and Superpositions 

The representation of a state p by a density operator pp is general enough to include the case of pure states. 
Indeed, it can be proven that if a density operator is also an orthogonal projector, then it is an orthogonal 
projector that projects onto one vector. 

A set of vectors B = {\u) : \u) G C"} is an orthonormal base of C" iff (1) the set of vectors i? is a generating 
set for C", which means that each vector of C" can be written as a linear combination, i.e. superposition, of 
vectors of B, (2) each of the vectors of B has length equal to 1, i.e {u\u) — 1 for each \u) S B, and (3) each 
two different vectors of B are orthogonal to each other, i.e. (vlw) — for \v), \w) G B and \v) ^ It can 
be shown that any orthonormal base of C" contains exactly n elements. Given such an orthonormal base B of 
C", any vector |a:) € C" can be uniquely written as a linear combination or superposition of the vectors of this 
base. This means that there exist superposition coefficients q;„ € C such that \x) — X]|u)eB ctu\u)- Making use 
of ^ we have {u\x) = {u\J2\v)eB = J2\v)eB '^viulv) = au, hence 

\x) = ^ \u){u\x) (15) 
|ii>e-B 

From this it follows that 

E N("l = l (16) 

\u)eB 

which is called the 'resolution of the unity' in Hilbert space mathematics. Consider the projector that projects 
on \u) and denote it P^. Suppose that \x) is a unit vector. Then we have \x) = X]|u)gs ^"1^)- Taking into 
account (fT5|l gives us P„ = We also have Pu\x) — a„|u) and hence 

(x|P„|a;) = a„a* = |a„p (17) 

This proves that the coefficients of the superposition of a unit vector \x) in an orthonormal base B have a 
specific meaning. From H12|l and IjlTI) it follows that they are the square root of the probability that the state 
of the concept represented by |a;) changes under the influence of the context represented by Pu. 

It is easy to see that the quantum model is a specific realization of a SCOP. Consider the complex Hilbert 
space C", and define Eg = {pp | pp is a density operator of H}, Mq = {Pe \ Pe is an orthogonal projection 
operator of Ti}, Cq = {Pa \ Pa is an orthogonal projection operator of H}, and the functions p and i/ such that 
PQ{q,e,p) = TrppPe, VQ{p,a) = TrppPa and p^ = PePpPe/TrppP^, then {T.q,Mq,Cq,pq,vq) is a SCOP. 



3 A Hilbert Space Representation of a Concept 

In this section we explain how the quantum mechanical formalism is used to construct a model for a concept. 
We limit ourselves to the construction of a model of one concept. In the next section we explain how it is 
possible to model combinations of two or more concepts. 
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exemplar 


context 


state 


rabbit 


ei3 


P13 


cat 


ei4 


Pl4 


mouse 


ei5 


Pl5 


bird 


ei6 


Pm 


parrot 


ei7 


Pl7 


goldfish 


ei8 


P18 


hamster 


ei9 


Pl9 


canary 


620 


P20 


guppy 


621 


P21 


snake 


622 


P22 


spider 


623 


P23 


dog 


624 


P24 


hedgehog 


625 


P25 


guinea pig 


626 


P26 



Table 1: States and contexts relevant to exemplars of the concept 'pet'. 
3.1 Basic Contexts and Basic States 

Let us re-analyze the experiment in greater detail, taking into account the structure of SCOP derived in For 
this purpose, the states and contexts corresponding to the exemplars considered in Table 2 of [J] are presented 
in Tabled So, for example, eig is the context 'The pet is a hamster', and pis is the state of 'pet' under 
the context eis, 'The pet is a mouse'. In the experiment, subjects were asked to estimate the frequency of a 
specific exemplar of 'pet' given a specific context; for example, the exemplar cat for the context ei, 'The pet is 
chewing a bone', the frequency of the exemplar dog for the context 62, 'The pet is being taught', etc .... These 
estimates guide how we embed the SCOP into a Hilbert space. The hypothesis followed in the construction 
of the embedding is that the frequency estimates reflect the presence of contexts that are stronger than those 
explicitly considered in the model, and the distribution of these contexts reflects the frequencies measured in 
the experiment. Let us call these contexts basic contexts. For example the contexts 

627, 'I remember how I have seen my sister trying to teach 

her dog to jump over the fence on command' (18) 

628, 'A snake as pet, oh yes, I remember having seen that weird guy 

on television with snakes crawling all over his body' (19) 

629, 'That is so funny, my friend is teaching his parrot to say my name 

when I come in' (20) 

could be such basic contexts. And indeed we have 627 < 62 and 627 < 624, 628 < 64 and 628 ^ 622, and, 629 < 65 
and 629 < ei7, which shows that these contexts are stronger than any of those considered in the model. Let us 
denote X the set of such basic contexts for the concept 'pet'. 

Here we see how our model integrates similarity based and theory based approaches. The introduction of 
this set of contexts might give the impression that basic contexts play somewhat the same role as exemplars 
play in exemplar models. This is however not the case; we do not make claims about whether basic contexts are 
stored in memory. It is possible, for example, that it is a mini-theory that is stored in memory, a mini-theory 
that has grown out of the experience a subject has had with (part of) the basic contexts, and hence incorporates 
knowledge about aspects (for example frequency of appearance in different contexts) of the basic contexts in this 
way. But it is also possible that some basic contexts are stored in memory. At any rate, they play a structural 
role in our model, a role related directly to the concept itself. To clarify this, compare their status to the status 
of a property. The property 07, can swim is a property of the concept 'goldfish' independent of the choice of a 
specific theory of concept representation, or independent of what is or is not stored in memory. 

We now introduce some additional hypotheses. First, we suppose that each basic context is an atomic 
context of M. This means that we stop refining the model with basic contexts; it amounts to demanding that 
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exemplar 


ei 


62 


63 


64 


65 


66 


1 




n{Ei) = 303 


n(£2) = 495 


71(^3) = 500 


n{EA) = 101 


7i(£;5) = 200 


77(£;6) = 100 


n = 1400 


rabbit 


ni3,i = 12 


7ll3,2 — 35 


7713, 3 = 75 


7713, 4 = 5 


7713.5 = 2 


7713,6 = 


77(£i3) = 98 


cat 


ni4_i = 75 


7714, 2 ~ 65 


7714, 3 = 110 


77l4,4 = 3 


7714,5 = 6 


7714, 6 = 1 


7l(£i4) = 168 


mouse 


ni5,i = 9 


7715, 2 = 30 


7715,3 = 40 


7715,4 = 11 


7715,5 = 2 


7715,6 = 


77(£i5) = 70 


bird 


"■10,1 = 6 


7716,2 = 40 


7716, 3 = 10 


7716, 4 = 4 


7ll6,5 = 34 


7716,6 = 1 


7j(£i6) = 112 


parrot 


ni7,i = 6 


7717, 2 = 80 


77l7,3 = 5 


77l7,4 = 4 


ni7_5 = 126 


77l7,6 = 1 


7l(£i7) = 98 


goldfish 


ni8,i = 3 


7718,2 = 10 


7718,3 = 


77l8,4 = 2 


7718,5 = 


7718, 6 = 48 


7i(£i8) = 140 


hamster 


ni9,i = 12 


7719,2 — 35 


7719, 3 = 30 


7719,4 = 4 


7ll9,5 = 2 


7719,6 = 


77(^19) = 98 


canary 


7120,1 = 3 


7720,2 = 35 


7720,3 = 5 


7720,4 — 2 


7120,5 = 14 


7720,6 = 1 


77(^20) = 112 


guppy 


n2i,i = 3 


7721,2 — 10 


7721,3 = 


7721,4 = 2 


7721,5 = 


7721,6 = 46 


n{E2i) = 126 


snake 


n22,i = 6 


7722,2 = 10 


7722,3 = 5 


7722,4 ~ 22 


7722,5 = 


7722,6 = 1 


77(^22) = 42 


spider 


7123,1 ~ 3 


7723,2 = 5 


7723,3 = 15 


7723,4 = 23 


7723,5 = 


7723,6 = 


77(^23) = 28 


dog 


7124,1 = 150 


7724,2 = 95 


7724,3 = 120 


7724,4 = 3 


7724,5 = 12 


7724,6 = 1 


77(^24) = 168 


hedgehog 


7125,1 = 6 


7725,2 = 10 


7725,3 = 40 


7725,4 = 12 


7725.5 = 


7725,6 = 


77(^25) = 42 


guinea pig 


7126, 1 = 9 


7726,2 = 35 


7726,3 = 45 


7726,4 = 4 


7726.5 = 2 


7726,6 = 


77(^26) = 98 



Table 2: Choice of the distribution of the different types of basic contexts for the concept 'pet'. 



there are no stronger contexts available in the model. They are the most concrete contexts we work with. As 
mentioned in Section 3.5 of [7], even if a context is an atomic context, there still might be several eigenstates 
of this context. As an additional hypothesis, we demand that each basic context has only one eigenstate in 
the model. This means that also on the level of states we want the basic contexts to describe the most refined 
situation. Indeed, if an atomic context has different eigenstates, the states penetrate more deeply into the 
refinement of the model than the contexts do. So our demand reflects an equilibrium in fine structure between 
states and contexts. The set of eigenstates of the atomic contexts we denote C/, and we call the elements of U 
basic states. The basic states and contexts are not necessarily possible instances of the concept, but an instance 
can play the role of a basic state and context. Basic states and contexts can be states and contexts that the 
subject has been confronted with in texts, movies, dreams, conversations, etc .... Let us introduce 

Ei = {u \ u < ei,u E X} and Xij = {u | m < A Cj, m G X} (21) 

where is the set of basic contexts that is stronger or equal to e^, and Xij the set of basic contexts stronger 
or equal to Ci A Cj . It is easy to prove that Xij = EiD Ej . Indeed, we have u S Xij u < Ci A Cj u < ei and 
u < ej -i^ u € Ei n Ej . Suppose that n is the total number of basic contexts. Let us denote n{Xij) the number 
of basic contexts contained in Xij and n{Ei) the number of basic contexts contained in Ei. We choose n{Xij) 
and n{Ei) as in Table El (we have denoted n{Xij ) as Uij in Table EJ. 



3.2 Embedding in the Hilbert Space 

We consider a Hilbert space of dimension 1400, hence C", with n ~ 1400. Each basic context u E X \s 
represented by a projector where \u) G C" is a unit vector, and such that B = {\u) ju G X} is an 

orthonormal base of the Hilbert space C", and the corresponding basic state w G t/ is represented by this unit 
vector \u) G B. The ground state p of the concept 'pet' is represented by a unit vector \xp), superposition of 
the base states B = {\u) | m G X} 



\xp) = ^ au\u) where = {u\xp) (22) 
|a„p is the probabihty that the concept 'pet' changes to be in base state \u) under context u. We write 



= V7.GX (23) 
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This means that each of the basic states u € U is considered to have an equal probabihty of being ehcited. We 
can rewrite the ground state p of 'pet' more exphcitly now 



-p)=J:-7^J-) (24) 



This means that if the concept 'pet' is in its ground state p, there is a probabihty of 1/1400 that one of the 
contexts u E X acts as a basic context of 'pet', and changes the ground state of 'pet' to the basic state u E U oi 
'pet'. This means that for 'pet' in its ground state, the probabihty that a basic context that is contained in Ei 
gets activated and changes the ground state of 'pet' to the corresponding basic state, is given by n(£'i)/1400, 
where n{Ei) is given in Table El Let us show that a straightforward calculation proves that this gives exactly 
the weights in Table 2 of iZj. Following Tabled in 98 of the 1400 basic contexts the pet is a hamster. This 
means that the weight of hamster \n the ground state of 'pet' is 98/1400 = 0.07, which indeed corresponds with 
what we find in Table 2 of [7] for hamster. In 28 of the 1400 basic contexts, the pet is a spider. Hence the 
weight of spider in the ground state of 'pet' is 28/1400 = 0.02, as in Table 2 of |7|. There are 168 of the 1400 
basic contexts where the pet is a dog, which means that the weight for dog is 168/1400 = 0.12, as in Table 2 of 

m 

Now that we have introduced the mathematical apparatus of the quantum model, we can show explicitly 
how a context changes the state of the concept to another state, and the model remains predicting the data of 
the experiment. Consider the concept 'pet' and the context ei, 'The pet is chewing a bone'. The context ei is 
represented by the projection operator Pei given by 



Pe, = (25) 



ueEi 



where Ei is the set of basic contexts that is stronger than or equal to ei, hence Ei — {u \ u < ei,u E X}. Let 
us calculate the new state \xp^) that \xp) changes to under the influence of ei. Following lfTT|) we have 



Pei \Xp) 



V (^^pl^ei \Xp) 

Let us calculate this new state explicitly. We have 



(26) 



Pe,\xp) = W)H^p) = E 7^i"> (2^) 



and 



1 303 

{xp\PeAxp) = E i^Mi^l^p) - E = E TIH?^ = TIHH (28) 

This gives 



^ 1400 1400 



e4 

^-^ . /or 



(29) 



3.3 Different States and Different Weights 

We can now show how the quantum model predicts different weights for the contexts corresponding to the 
different exemplars in the experiment. Consider for example the context ei4, 'The pet is a cat', and the 
corresponding state pi4, 'The pet is a cat', and calculate the probability that pi collapses to pi4 under context 
ei4. First we must calculate the orthogonal projection operator of the Hilbert space that describes 614. This 
projection operator is given by 

Pe,,^ E (30) 

where £'14 — {u\u < ei4,M E X}. Following the quantum mechanical calculation in 1)12(1 . we get the weight of 
the exemplar cat under context ei, i.e. the probability that state pi collapses to state pi4 under context 614, 
'The pet is a cat'. We have 

^(pi4,ei4,pi) = (a;pjPeiJxpi) (31) 
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which gives 

{XpAPe^AXp^) = ^ (XpJu)(u|XpJ = XI XI XI (32) 

1 17^ 
- E E E 303^(». E 303 - 303 ^"-^-^ 

corresponding with the experimental result in Table 2 of [7j- In contrast, let us calculate the weight of the 
exemplar cat for 'pet' in the ground state p. Applying the same formula 1)12(1 we have 

Ai(pi4,ei4,p) = (XplFeiiNp) (34) 

and 

This also corresponds to the experimental results in Table 2 of |7]. 

Let us make some more calculations of states and weights corresponding to exemplars and contexts of the 
experiment. Consider the context ee, 'The pet is a fish'. This context ee is represented by the projection 
operator P^g given by 

Pe, - E I") ("I (36) 

ueEe 

where Eq is the set of basic contexts that is stronger than or equal to eg. Hence Eq = {u \ u < bq^u ^ X}. 
Following ((ll|l we get the following expression for the state \xpg) 



Pee \ Xp) 



(37) 



\/ {Xp\Pee\Xp) 

We have 

Pee\Xp) = X = X ^i'") (38) 



VT400 

and ^ 

{Xp\Pee\Xp) = X {^p\u){u\xp) = ^ K^^pl")!^ = X ^ (3^) 

tiG-Be mGEs iiGiSe 

This gives 

I^Pe) = X ^1") (40) 



uG-Ee 

Suppose we want to calculate the weights of the exemplar 'hedgehog' for this state. Again using formula 112|l 
we get 

M(P25,e25,P6) = {Xpe\Pe25\Xpe) (41) 

From Table |2] follows that 7125,6 = 0, which means that £^25 H iSg = 0. We have no basic contexts in our 
model where the pet is a fish and a hedgehog. This means that Peas l^pe)' ^.nd hence Pe^^la^pg) = |0). As a 
consequence we have fJ.{p25, 625,^6) = 0, which corresponds to the experimental result in Tabic 2 of [7]. 
Let us calculate the weight for the exemplar goldfish in the state pe. We have 

M(Pl8,ei8,P6) = {Xpe\Peis\Xpe) (42) 

where 

Pe^s = X I") ("I (43) 
uG-Big 



8 



and Eis — {u \ u < eis,u € X}. Following ifT^ this gives 



100 

iiG-Eis veEe weEe uG-Eign-Eg 

corresponding with the experimental result in Table 2 of |Z| . 

The foregoing calculations show that our SCOP theory in Hilbert space is able to model the experimental 
data of the experiment put forward in Section 2.2 of 7 . The choice of the distribution of the basic contexts and 
states as presented in Table |21 and the corresponding dimension of the Hilbert space, is crucial for the model 
to predict that experimental data of the experiment. It is possible to see that the distribution of basic contexts 
and states (Table EJ corresponds more or less to a set theoretical model of the experimental data, such that the 
Hilbert space model can considered to be a quantization, in the sense used in quantum mechanics, of this set 
theoretical model. 



4 Combinations of Concepts in the SCOP Model 

The previous section explained how to build a model of one concept. This section shows that conceptual 
combinations can be described naturally using the tensor product of the corresponding Hilbert spaces, the 
procedure to describe compound entities in quantum mechanics. We give an explicit model for the combinations 
of the concepts 'pet' and 'fish', and show how the pet fish problem is thereby solved. Then we illustrate how 
combinations of more than two concepts can be described. First we need to explain what the tensor product is. 

4.1 The Tensor Product and Entanglement 

Consider two quantum entities S and T described respectively in Hilbert spaces TC^ and TC^ . In quantum 
mechanics there exists a well known procedure to describe the compound 5 (8) T of two quantum entities 5* and 
T by means of the Hilbert space Ti^ 7i^, which is the tensor product of the Hilbert spaces and . The 
tensor product behaves like a product; for example, take a G C, |a;'^) G and \x'^) G , then we have 

a(|x^) ® |a;^)) = ® \x^) = \x^) ® {a\x'^)) (46) 

However, it is not commutative, meaning that even when a Hilbert space is tensored with itself, for \x) ^ H 
and \y) £ H we have |a;) ® |y) £H(^Ti. is in general not equal to |y) \x). The mathematical construction of 
the tensor product in all its details is not trivial. The best way to imagine what the tensor product space is 
like is to consider two orthonormal bases and respectively of the subspaces Ti^ and and note that 
the set of vectors {\u^) : \u^) e B^ , G B^} is an orthonormal base of the tensor product (g) . 

Concretely this means that each vector \z) G Ti^ (8) Ti^ can be written as a linear combination of elements of 
this orthonormal base 

a„s,„T|w^)® (47) 

We need to explain some of the more sophisticated aspects of the tensor product, because they are crucial for 
the description of conceptual combinations. The first aspect is that vectors of the tensor product can be product 
vectors or nonproduct vectors. The difference between them can be illustrated with a simple example. Consider 
the tensor product ® C^, and two vectors \x),\y) G C'^, and their tensor product \x)(E)\y) G (8)C^. Suppose 
further that |u)2 is an orthonormal base of C^, which means that we can write 

\x) =a\u)i+f3\u)2 and \y) = -f\u)i + S\u)2 (48) 

which gives 

\x)(g)\y) = ia\u)i+f3\u)2)(E>{-f\u)i+S\u)2) (49) 

= a'y\u)i(g)\u)i+ad\u)i(E)\u)2 + (3j\u)2<E)\u)i+ l3S\u)2\u)2 (50) 



9 



Taking into account the uniqueness of the decomposition in (|47|l we have 

\x) ® \y) = q;ii|m)i ® \u)i + Q;i2|u)i ® |u)2 + a2i|w>2 ® \u)i + 0122^)2 ® |w)2 (51) 

with 

ail = Oil 0ii2 = ol5 021 = Pi OL22 = PS (52) 
It is easy to see that an arbitrary vector \z) S is not always of the form \x) \y). For example, choose 

|z) = |u)i ® |u)i + |u)2 ® |u)2 (53) 

This amounts to choosing in the decomposition of \z) following formula l|47|l an — 0121 — 1 and Q!i2 = 021 = 0. 
If \z) chosen in this way were equal to a product vector like ® \y), we would find a, 7, (5 G C such that H52|l 
are satisfied. This means that 

q;7 = /3(5 = 1 and ab = /37 = (54) 

This is not possible; there does not exist Q!,/9,7,(5 that satisfy (|54|l . Indeed, suppose that ab = 0, then one of 
the two a or S has to equal zero. But then one of the two 07 or pb also equals zero, which proves that they 
cannot both equal 1, as demanded in (|54|l . This proves that \z) = \u)i |m)i + \u)2 (81 |u)2 is a nonproduct 
vector, i.e. it cannot be written as the product of a vector in with another vector in C^. 

Nonproduct vectors of the tensor product Hilbert space represent nonproduct states of the compound concept 
described by this tensor product Hilbert space. It is these nonproduct states that contain entanglement, meaning 
that the effect of a context on one of the two sub-entities (sub-concepts) also influences the other sub-entity 
(sub-concept) in a specific way. As we will see, it is also these nonproduct states that make it possible to 
represent the relation of entanglement amongst sub-concepts as one of ways concepts can combine. Specifically 
(as we will show explicitly in Section l4. 4(1 combinations like 'pet fish' are described as entangled (nonproduct) 
states of 'pet' and 'fish' within the tensor product of their respective Hilbert spaces. 

A second aspect of the tensor product structure that must be explained is how projectors work. Projectors 
enable us to express the infiuence of context, and how transition probabilities and weights are calculated. 
Suppose we consider a context e"^ G A^s of the first concept S, represented by a projection operator of the 
Hilbert space . This context can be considered as a context of the compound S (^T oi the two concepts 
S and T, and will then be represented by the projection operator (g) 1^ , where 1^ is the unit operator on 
Ti.^ . If we have a context e'^ G of the first concept S and a context £ of the second concept T, 
represented respectively by projection operators and P^, then P^ ® P^ represents the context e"^ ® of 
the compound concept S (^T. We have 

Pf (E) Pj(|x^) «) = P^\x^) ® Pe\x^) (55) 

The transition probabilities and weights are calculated using the following formulas in the tensor product 

{x'^ ^x^ly'^ ^y'^) ^ {x'^\y'^){x^\y^) and TriA'^^ (E) A^) = TrA'^ ■ TrA^ (56) 

A third aspect of the tensor product is the reduced states. If the compound quantum entity 5' (X) T is in a 
nonproduct state \z) G (8) of the tensor product Hilbert space of the two Hilbert spaces and Tf" 
of the sub-entities, then it is not obvious what states the sub-entities are in, because there are no vectors 
\x^) G and \x'^) G such that \z) = \x^) (g) \x'^). This means that we can say with certainty that for 
such a nonproduct state \z), the sub-entities cannot be in pure states. It can be proven in general that the 
sub-entities are in density states, and these density states are called the reduced states. We do not give the 
mathematical construction since we only need to calculate the reduced states in specific cases, and refer to |13| . 
11-7, for a general definition and derivation of the reduced states. 

4.2 Combining Pet and Fish 

In this section we use the quantum formalism to describe how the concepts 'pet' and 'fish' combine, and see 
that the 'pet fish problem' El 1121 El Elj finds a natural solution (see for a presentation of the pet fish 
problem) . 



10 



We first have to build the quantum model for the concept 'fish', and then combine this, using the tensor 
product, with the quantum model for 'pet'. To provide the necessary data, another experiment was performed, 
using the same subjects and data acquisition methods as for the experiment in |7j. Subjects were asked to rate 
the frequency of appearance of different exemplars of 'fish' under two contexts: 

g/is/i^ 'The fish is a pet' (57) 

and the unity context 1^*^^. We denote the ground state of 'fish' by pf^'^^ and the state under context egg*'' by 
pIq^^ ■ The results are presented in Table |31 We note a similar effect than observed previously for the concept 
'pet'. For example, the weights of goldfish and guppy are greater under context e^Q*'' than for the ground state 
under the unity context I-''"*'*, while the weights of all other exemplars are lower. 



exemplar 


fish 






rate 


freq 


rate 


freq 


trout 


0.54 


0.02 


4.67 


0.09 


shark 


0.51 


0.02 


4.37 


0.09 


whale 


0.15 


0.01 


3.36 


0.07 


dolphin 


0.91 


0.04 


3.72 


0.07 


pike 


0.37 


0.01 


2.94 


0.05 


goldfish 


6.73 


0.40 


5.19 


0.10 


ray 


0.27 


0.01 


3.10 


0.06 


tuna 


0.19 


0.01 


4.57 


0.09 


barracuda 


0.40 


0.01 


1.53 


0.03 


mackerel 


0.19 


0.01 


3.47 


0.07 


herring 


0.22 


0.01 


4.46 


0.09 


guppy 


6.60 


0.39 


4.10 


0.08 


plaice 


0.22 


0.01 


3.56 


0.07 


carp 


1.21 


0.05 


3.21 


0.06 



Table 3: Frequency ratings of different exemplars of the concept 'fish' under two contexts 

Let us call X^^^'^ the set of basic contexts and [7^*^'' the set of basic states that we consider for the concept 
'fish'. We introduce the states and contexts corresponding to the different exemplars that we have considered 
in the experiment in Tabled) So, for example, the context 634'''' is the context 'The fish is a dolphin' and the 
state p'!^Q^ is the state of 'fish' which is the ground state pf^^'^ under the context cIq'''', 'The fish is a mackerel'. 
Further we introduce 

E('''' = {u\u< ef''\ u e X^*^''} and x(;'^ ^{u\u< e{''^ A ef ^^ u e X^''''} (58) 

where e(^^^ is the set of basic contexts that is stronger or equal to ef**'' and x(^'^^ the set of basic contexts 
that is stronger or equal to ef**'' A e^'*''. We have X^j'^'^ = e(^'^'^ n E'J*^''. Suppose that m is the total number 
of basic contexts. Let us denote by m{X(^^'^) the number of basic contexts contained in xf^^'^ and by m(_E/**'') 
the number of basic contexts contained in e(^'^'^ . We choose m{X^^^^'^) and to(£'/*'*'') as in Table [S] For the 
quantum model of the concept 'fish', we consider a Hilbert space C™ of 408 dimensions. 

Let us construct the quantum model for the concept 'fish'. Each basic context u G X^"^^^ is represented by 
a projector where \u) G is a unit vector, and such that B-f^'^^ = {\u) \u e X-^*'*''} is an orthonormal 

base of the Hilbert space C". The basic state corresponding to the basic context u is represented by the vector 
\u). The ground state p/'*'' of the concept 'fish' is represented by the unit vector |a;|*'*''), superposition of the 
base states B-f^'^^ = \ u G X-f^'^^} using the following expression: 

V -^\u) (59) 
^ ^„ V408 

Hence if the concept 'fish' is in its ground state pf^'^'^ there is a probability of 1/408 that one of the basic states 
u G U^^'^'^, under contexts u G X^'^''^, is elicited. This means that for 'fish' in its ground state, the probability 
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exemplar 


context 


state 


trout 


^31 




shark 


^32 


P32" 


■whale 


^33 


piT 


dolphin 


^34 


piT 


pike 


^35 


Pz"" 


goldfish 


^36 


pie" 


ray 


^37 




tuna 


^38 




barracuda 


639 




mackerel 


/ IS/i 

^40 


fisti 

P40 


herring 


ftsh, 
641 


ttsli 

P41 


guppy 


ftsh, 
C42 


ttsli 

P42 


plaice 


fish 
643 


fish. 

P43 


carp 


j ish 
^44 


fisti 

P44 



Table 4: The states and contexts connected to the exemplars of the concept 'fish' that we considered 

that a basic state gets elicited corresponding to a context contained in iJj is given by m )/408, where 

m{E{^'^^) is given in Table El A straightforward calculation proves that this gives exactly the weights in Table 
El Let us look at some examples. Following Table El in 20 of the 408 basic contexts, the fish is a pike. This 
means that the weight of pike in the ground state of 'fish' is 20/408 = 0.05, which indeed corresponds to what 
we find in Table El for pike. In 28 of the 408 basic contexts, the fish is a dolphin. Hence the weight of dolphin 
in the ground state of 'fish' is 28/408 = 0.07, as can be found in TablcEl In 32 of the 408 basic contexts, the 
fish is a guppy, thus the weight for guppy is 32/408 = 0.08, as in Table El 

Now consider the concept 'fish' and the context e^g^'', 'The fish is a pet'. The context 63^'*'' is represented 
by the projection operator PI^^^ given by 

pi:t- y. I") ("I (60) 



630 / y 

uGE. 



fish 
30 



where £'30''^ is the set of basic contexts of 'fish' that is stronger than or equal to e^Q*'', hence E^q^'^ — {u \ u < 
eil''',u G X^-''}. Let 1 
Following (|ll|l we have 



^30'*'')^ S X-'^*'*''}. Let us calculate the new state \x^pll^) that |a;^*^'') changes to under the influence of e^**'' 



pfish\ fish-. 

I./-'') = ' ^ \ (61) 

We have 



and 



This gives 



(-nniri^'^') = E E E (63) 

y ^=1") (64) 



fish 



4.3 The Compound Pet eg) Fish 

The compound of the concepts 'pet' and 'fish', denoted 'pet (Xi fish', is described in the space C" (X) C™. A 
specific combination does not correspond to the totality of the new concept 'pet (X fish', but rather to a subset 
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exemplar 


^30 






/ f is/l \ -1 r\r\ 

m{eio ) = 100 


m = 408 


trout 


"T-(^31,l ) = 2 


"iC-Ba'i ) = 36 


shark 


/ ■\r t ish.\ n 

■m{Xi2,i ) = 2 


mi^L ) = 36 


whale 


"T-(^33,l ) = 1 




dolphin 


/ \r t ish\ A 
"^(-^34,1 ) = 4 


/ j-1 tish.\ r\ci 

m[E^^ ) = 28 


pike 


"T-(^35,l ) = 1 


"^C-Es's ) = 20 


goldfish 


^{^k.i ) = 40 


/ j-i tish.\ A rt 

m{Eli6 ) = 40 


ray 


"T-(^37,l ) = 1 


m{Ei^j ) = 24 


tuna 


/ ■\r t ish\ 1 
'"('^SS,! ) = 1 


m{E;is ) = 36 


barracuda 


"T-(^39,l ) = 1 


"i(S^9 ) = 12 


mackerel 


m(XiJ7) = 1 


miEi^'^'^) = 28 


herring 


m(xi;,r) = 1 


m(£;if'') = 36 


guppy 


m{Xii:,^) = 39 


m{Ei.l"') = 32 


plaice 


"^(^ia.T) = 1 


"^(fiir") = 28 


carp 




m(i5ir'^) = 24 



Table 5: Choice of the distribution of the different types of basic contexts for the concept 'fish' 



of it. For example, the combination 'a pet and a fish' is one subset of states of 'pet (g) fish', and the combination 
'pet fish' is another. As we will see, 'a pet and a fish' corresponds to a subset containing only product states of 
'pet fish', while 'pet fish' corresponds to a subset containing entangled states of 'pet (g) fish'. Let us analyze 
what is meant by different possible states of the compound 'pet (g) fish' of the concepts 'pet' and 'fish', hence 
vectors or density operators of the tensor product Hilbert space C" C"' . 

The first state we consider is pP^* (g) pf'^^^ ^ the tensor product of the ground state fP"^* of 'pet' and the 
ground state pl^^'^ of 'fish' , which is represented in C" ® C™ by the vector \x^p*) ® This state is a 

good representation of the conceptual combination 'pet and fish', because for 'pet and iish', contexts can act 
on 'pet', or on 'fish', or both, and they act independently. More concretely, consider the context e^"^*, 'The pet 
is chewing a bone' acting on the concept 'pet'. This context, then written like e^^* (g) can also act on the 

'pet' sub-concept of 'pet fish'. Then this will just change the ground state p^'^* of 'pet' to state p^* , and the 
ground state pf^'^*^ of the 'fish' sub-concept of 'pet ® fish' will not be influenced. This is exactly the kind of 
change that the state represented by \x''p^) ® \xp''^'^) entails. 



Hence 



jP-t^^pP^-t ^ pPet ^ pf^sh -r^"" ^pet ^ .f^sh (gg) 



^ pP^' ® pH'"' ^ pT^pg'"" (66) 

Similarly, a context that only works on the concept 'fish', can work on the 'fish' sub-concept of 'pet (g) fish', and 
in this case will not influence the state of 'pet'. Hence 



1 pet r~. fish 

pet ^ ■' fish ^^30 pet ^ fish ^no\ 

pP (g)pJ*^" , — > pP (g)p^p (68) 



Another state to consider is p^^^ ® pi})^ ^ represented by the vector |a;^^*) (g) ja;^*^''). This is a state where the 
'pet' is a 'fish' and the 'fish' is a 'pet'; hence perhaps this state faithfully represents 'pet fish'. How can we check 
this? We begin by verifying different frequencies of exemplars and weights of properties in this state, and seeing 
whether the guppy effect, described in Section 2.1 of [7], is predicted by the model. gives the calculation 
for the weight of the exemplar goldfish for the concept 'pet' in state p^* ■ Now we calculate the weight for the 
exemplar goldfish for the compound concept 'pet (g fish' in state p^^ ^Paa^ ■ Following the quantum mechanical 
rules outhned in (|55|l we need to apply the projector PP^^ (g) f/**'* on the vector jx^^*) (g \ylll^)^ and use it in 
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the quantum formula H12|l . This gives: 



= «*l^eClO(^^:f l^^:f > = i^TlPeSKf) (70) 

48 

= — = 0.48 (71) 
100 ^ ' 

This means that the weight of the exemplar goldfish of the sub-concept 'pet' of the compound 'pet (g) fish' in the 
product state pg*^* ®pi})^ (the state that represents a 'pet ® fish' that is a pet and a fish), is equal to the weight 
of the exemplar goldfish of the concept 'pet' in state j^^* (the state that represents a pet that is a fish). This 
is not surprising; it simply means that the tensor product in its simplest type of state, the product state, takes 
over the weights that were there already for the separate sub-concepts. The guppy effect, identified previously 
in states pg^' of the concept 'pet' and p{g^'' of the concept 'fish', remains there in this combination of pet and 
fish described by this product state pg*^* (gjpgQ*''. Indeed, we can repeat the calculation of l|69|l on the product 
state of the ground states — hence the state p^^* ® pf^^h — ^^^^^ g^^j 

MP?8*®/*^'\e?f 0l^■'^^p''^*®/*^") = ((xf|®(xf |)(Fr^f ®l^-")(|a:f )®|4^^'')) (72) 

140 

= 0.10 (74) 



1400 

We see that the weight of goldfish for the sub-concept 'pet' of the compound 'pet fish' equals the weight 
of goldfish for the concept 'pet' in the ground state pP*^'. The difference between (|71|l and 174|) is the guppy 
effect in our theory of the compound 'pet (g) fish'. It should be stated in the following way. The weight of 
goldfish of the concept 'pet' equals 0.10 if 'pet' is in its ground state, and equals 0.48 if 'pet' is in a state 
under the context 'The pet is a fish'. This is the pre-guppy effect identified by introducing contexts for the 
description of one concept, namely 'pet'. When 'pet' combines with 'fish' we get the concept 'pet fish'. Now 
the guppy effect manifests in the following way. The weight of goldfish for 'pet' as a sub-concept of 'pet (E) 
fish' equals 0.10 if the state of 'pet (g) fish' is such that we have 'a pet and a fish' in the state 'a pet . . . and 
... a fish' (without necessarily the pet being a fish and the fish being a pet, this is the product state of the 
two ground states, hence p^®* ®p^^'^^). The weight of goldfish for 'pet' as a sub-concept of 'pet' ® fish' equals 
0.48 if the state of 'pet ® fish' is such that we have 'a pet and a fish' in a state where the pet is a fish and 
the fish is a pet (this is the product state pg*^* ®Pyo^)- So we get the guppy effect in the combination of the 
concepts 'pet' and 'fish'. But does this mean that the state p^* ® pio''^ describes a 'pet fish'? The weights 
of exemplars seem to indicate this, but there is still something fundamentally wrong. Look at formula (|69l) . 
It reads /^(Pig' ® , g' ® l^^'^^^p^* ®pio'^)- This means that under the infiuence of context e^g* (8) 1-^**'' 
state p\^* (g) pi^'^ changes to state p^g* ® pio'^ ■ The state pg*^* (g) p^o"*'' is a product state of the compound 'pet 
(g) fish' where the pet is a fish and the fish is a pet. But if 'pet' as sub-concept of the compound collapses to 
goldfish (this is the state transformation pg^* 1 — > Pig*)i we see that Pgg'*'' remains unchanged in the collapse 
translated to the compound (we have there pg*^* ®P'^^^^ 1 — > p\^ ® pio"^) ■ This means that the context 'The pet 
is a goldfish' causes 'pet' as a sub-concept to collapse to goldfish, but leaves 'fish' as a sub-concept unchanged. 
The end state after the collapse is p^g* ® P'^^^*^ , which means 'a goldfish and a fish' (pet has become goldfish, 
but fish has remained fish). We could have expected this, because the rules of the tensor product tell us exactly 
that product states behave this way. Their rules are given in symbolic form in (|65|l and H67I) . Product states 
describe combined concepts that remain independent, i.e. the concepts are combined in such a way that the 
infiuence of a context on one of the sub-concepts does not influence the other sub-concept. That is why, as 
mentioned previously, the product states describe the combination with the 'and' between the concepts; hence 
'pet and fish'. Then what does the product state Pg^* ®pi})'^ describe? It describes the situation where the pet 
is a fish, and the fish is a pet: hence two 'pet fish' and not one! And indeed, the mathematics shows us this 
subtlety. If for two 'pet fish', one collapses to goldfish, there is no reason at all that the other also collapses to 
goldfish. It might for example be goldfish and guppy. So to clarify what we are saying here, a possible instance 
of state pg*^* (g P30*'' of the compound 'pet g) fish' is 'a goldfish and a guppy'. Now we can see why this state 
P^^ (g P3Q^'' gives numerical indication of a guppy effect. But we did not really find the guppy effect, for the 
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simple reason that we did not yet identify the state that describes 'pet fish' (one unique hving being that is a 
'pet' and a 'fish'). It is here that one of the strangest and most sophisticated of aU quantum effects comes in, 
namely entanglement. 



4.4 The 'Pet Fish' as a Quantum Entangled State 

Consider the context 

645, 'The pet swims around the little pool where the fish is being fed by the girl' (75) 

This is a context of 'pet' as well as of 'fish'. It is possible to consider a big reservoir of contexts that have not 
yet been classified as a context of a specific concept. We denote this reservoir A4. This means concretely that 
j^pet Q g^j-^j j^fish ^ Lg|^ denote A1J"=*>/''''' the set of contexts that are contexts of 'pet' and also 
contexts of 'fish'. Amongst the concrete contexts that were considered in this paper, there are seven that are 
elements of Al''^*'^**'', namely 

66, ei8, 621, 630, 636, 642, 645 S 7V/{Pe*^/'«'» (76) 

We denote X'P'^'^^^'^'^^' the set of basic contexts that are contexts of 'pet' as well as contexts of 'fish'. We have 

* C Xf^*'/"'' and E^'^ C Xf^*'/"'' (77) 

and to model the concept 'pet fish' we make the hypothesis that iJg"^* — E^q'^'^ — £;pet,/is/i^ namely that the 
basic contexts of 'pet' where the pet is a fish arc the same as the basic contexts of 'fish' where the fish is a pet. 
It is not strictly necessary to hypothesize that these two sets are equal. It is sufficient to make the hypothesis 
that there is a subset of both that contains the basic contexts of 'pet' as well as of 'fish' that are also basic 
context of a pet that is a fish. 

We have now everything that is necessary to put forth the entangled state that describes 'pet fish'. It is the 
following state 

\s)^ ^ -l=\u)^\u) (78) 

We claim that this vector represents the state of 'pet (g) fish' that corresponds to the conceptual combination 
'pet fish'. Let us denote it with the symbol s. 

Now we have to verify what the states of the sub-concepts 'pet' and 'fish' are if the compound concept 'pet 
(g) fish' is in the state s represented by \s). Hence let us calculate the reduced states for both 'pet' and 'fish' of 
the state |s). As explained in Section im for a non- product vector, the reduced states are density operators, 
not vectors. We first calculate the density operator corresponding to \s) e C" (g) C™. This is given by 

We find the two reduced density operators by exchanging one of the two products \u){v\ by the inproduct {u\v). 
Taking into account that {u\v) = S{u, v), we have 

as reduced states for 'pet' and 'fish' respectively. It can be proven that these reduced states behave exactly 
like the states pg*^* and p^q'^'^ respectively. This means that for influences of contexts and weights of properties 
limited to one of the two sub-concepts 'pet' or 'fish', the state |s) behaves exactly as would the product state 
kp6*) ^ l^pao'')- '^^^^ means that as far as the weights of exemplars and properties are concerned, we find the 
values that have been calculated for the state |a;^g*) ® l^lH'^) in the previous section when the compound concept 
'pet (g) fish' is in the entangled state \s). 

Let us now see how the state \s) changes under the infiuence of the context e^g*® l-^**'', 'The pet is a goldfish' 
of the concept 'pet'. We have 

ppet^^f^s,^^ ^ |u>(^.|®l (81) 
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where = {u \ u < e^g*, m G X}. Hence the changed state of s under the influence of context efg* (g) l^^'^'^ — let 
us denote it s' — is given by 

W) = (Pf^f J2 E \u){u\®l^\v)^\v) (82) 

= E E 4=(^Hk>®b>= E E i^K«)i^>^b) (83) 



\u) (g) \u) (84) 



E 




18 ' 1-^6 

Calculating the reduced density states gives 

The reduced state |s')(s'|''^* with respect to the concept 'pet' is the state of 'pet' under the context Cg*'*, 'The 
pet is a fish', and the context efg*, 'The pet is a goldfish'. This is what we would have expected in any case, 
because indeed the context efg*, influences 'pet' alone and not 'fish'. However, the reduced state \s'){s'\f^'^^ with 
respect to the concept 'fish' after the change provoked by the context efg*, 'is a goldfish', that only infiuences 
the concept 'pet' directly, is also a state of 'fish' under the context 'is a pet' and under the context 'is a goldfish'. 
This means that if for 'pet fish' the pet becomes a goldfish, then also for 'fish' the fish becomes a goldfish. This 
is exactly what is described by the entangled state \s) of the tensor product space given in 1)78(1 . 

4.5 Combining Concepts in Sentences 

In this section we apply our formalism to model more than two combinations of concepts. Consider a simple 
archetypical sentence containing a subject, and object and a predicate connecting both: 'The cat eats the food'. 
Three concepts 'cat', 'eat' and 'food' are involved: two nouns and one verb. We want to show that it is possible 
to represent this sentence as an entangled state of the compound concept 'cat ^ eat (g) food'. 

We introduce the SCOPs of 'cat', 'eat' and 'food', (E'^"*, A^'^"*,/:'^"*, i/'^'^*), (E^-^*, TW^"*, r^'^*, /i^'^*, j/^'^*) 
and {T,^°°'',Mf°°'^, C^°°'^, fif°°'^, 1'^°°'^). M is the reservoir of contexts that have not been decided to be relevant 
for a specific concept, hence A^'^"* c M^M""-^ C M and M^""'^ C M. We choose Hilbert spaces 
and TL^""'^ to represent respectively the concepts 'cat', 'eat' and 'food'. Then we construct the tensor product 
Hilbert space TC^"-* (g) W^"* (g) T-Cf°°'^ to represent the compound concept 'cat (E) eat ® food'. Consider the three 
ground states \xf*) € T^''"*, {xf*) G W''* and \x(°°') € H^""'^ of respectively 'cat', 'eat' and 'food'. The 

product state ® {xp"'*) (E) |a;^°°'*) G E) H'^"'* (E) 71^°°'^ represents the conceptual combination 'cat and 

eat and food'. Although it is technically the simplest combination, the one described by the product state of 
the three ground states of each concept apart, it is rare in everyday life. Indeed, upon exposure to the three 
concepts 'cat' 'eat' 'food' in a row, the mind seems to be caught in a spontaneous act of entanglement that 
generates the sentence 'the cat eats the food'. We will come back to this later, because the same phenomenon 
exists with quantum entities. For the moment, however, let us consider the three concepts 'cat', 'eats' and 'food' 
connected by the word 'and' in a independent, hence non-entangled way; i.e. 'cat and eat and food' described 
by the product state |a;^°*) E) |a;|"*) E) \xp°'"^). Concretely this means that if a specific context infiuences the 
concept 'cat', then the concepts 'eat' and 'food' are not infiuenced. For example, suppose that the ground state 
|a;?<**) of the concept 'cat' is changed by the context 



-46 



'The cat is Felix' (86) 



into the state P4g*,'The cat is Felix'. If this context e^g* is applied to the compound concept 'cat E) eat ® food' 
in the product state (E \xp^^)(E Wp""*^), then the compound concept changes state to \x'^^^)(E (g) \xp°°'^) 

\xr) ® K') ® Wr") ^-'^r:®''°" I:.-*) ^ \xr) E> W;"") (87) 
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This state expresses 'Felix and eat and food' as a state of the compound concept 'cat i^i eat ig) food'. Can we 
determine the state of the compound concept 'cat (g) eat (g) food' that describes the sentence 'The cat eats the 
food'? Again, as in the case of 'pet fish' this will be an entangled state of the tensor product Hilbert space. 
Indeed, for the sentence 'The cat eats the food', we require that if, for example, 'cat' collapses to 'Felix', then 
also 'eat' must collapse to 'Felix who eats', and 'food' must collapse to 'Felix and the food she eats'. This means 
that the sentence 'The cat eats the food' is certainly not described by a products state of the tensor product 
Hilbert space. How do we build the correct entangled state? Let us explain this step by step so that we can see 
how this could work for any arbitrary sentence. 

First, we observe that the sentence itself is a context for 'cat', 'eat' and 'food'. Let us call it 647, hence 

647, 'The cat eats the food' (88) 

We have 647 G M, but also elf G M""^, elf G M""^ and e{^°'^ G Mf°°'^. Now we introduce £4,^ = {u \u < 
647, u G X} is the set of basic contexts that are stronger than or equal to 647. The entangled state, element of 
the tensor product Hilbert space W^"* (g) W®"* (g) H^°"'^, that describes the sentence 'The cat eats the food' is 
given by 

l^)= E ^4^1")® l">® l"> (89) 

where n(£'47) is the number of basic contexts contained in E47. 

Let UK show that this state describes exactly the entanglement of the sentence 'The cat eats the food'. We 
calculate the reduced states of 'cat', 'eat' and 'food' when the compound 'cat (g eat ig food' is in the state s 
represented by \s). We first calculate the density operator corresponding to \s). This is given by 

„t^,, Vn{Ei7) ^^^^ VHEir) 

= E -Ar^\u}{v\<^\u}{v\<S)\u}{v\ (91) 



This gives us 



\^)i^r= E ;77i^l")("l (92) 

\^)i^r= E ;i(^i-)("i (93) 

\')i'\'"'"= E -j^Mi^i (94) 

as reduced states for 'cat', 'eat' and 'food' respectively. These reduced states behave exactly like the states plf, 
plf and ^47°'^ of respectively 'cat', 'cat' and 'food', when it comes to calculating frequency values of exemplars 
and applicability values of properties. 

Let us now see how the state |s) changes under the influence of the context e^g* (g I''"* (g lf°'"^, 'The cat is 
Felix' of the concept 'cat' as a sub-concept of the compound concept 'cat eat (g food'. We have 

peat ^ -^eat ^ -^^food ^ ^ \u}{u\^ 1^1 (95) 

where E^q* = {u \ u < elf, u G X'^"-*}. Hence the changed state of s under the influence of context e^g* 1*^"* (g 
ifood — Yet us denote it s' — is given by 

W) = (PeT> 1^="* ® 1^°"')^) = E E . ]^ \v)<»\v)®\v) (96) 

Vn(i/47) 
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E ^■^— {u\v)\u)(E>\v)(E>\v) = Y (97) 

E J-— k)^!^)^!^) (98) 



Calculating the reduced density states gives 



The reduced state |s')(s'|'^°* with respect to the concept 'cat' is the state of 'cat' under the context 64^* A 647, 
'The cat is Fehx and the cat eats the food'. This is what we would have expected in any case, because indeed the 
context 640* ® l*^"* ® \food influences 'cat' alone and not 'eat' and 'food'. However, the reduced state |s')(s'|'^"* 
with respect to the concept 'eat' after the change provoked by the context e^g* (g) 1*^°* ® \ food^ 'The cat is Felix', 
that only influences 'cat' directly, is also a state of 'eat' under the context 645* A 647, 'The cat is Felix and the 
cat eats the food', hence 'Felix eats the food'. This means that if for 'The cat eats the food' the 'cat' becomes 
'Felix', then also 'eat' becomes 'Felix who eats'. A similar phenomenon happens for the concept 'food'. The 
reduced state \s'){s'\^°°'^ after the change provoked by the context e'^ ^V^^ (g)!^"""^ , 'The cat is Felix', that only 
influences 'cat' directly, is also a state of 'food' under the context 645* A 647, 'The cat is Felix and the cat eats 
the food', hence 'Felix eats the food'. This means that if for 'The cat eats the food' the 'cat' becomes 'Felix', 
then also 'food' becomes 'Felix who eats the food'. The approach that we have put forward in this article can 
be used to elaborate the vector space models for representing words that are used in semantic analysis. The 
tensor product, and the way that we introduced entangled states to represent sentences, can be used to 'solve' 
the well known 'bag of word' problem (texts are treated as 'bag of words', hence order and syntax cannot be 
taken into account) as formulated in semantic analysis In a forthcoming paper we investigate more directly 
how the quantum structures introduced in 0, i.e. the complete orthocomplemented lattice structure, can be 
employed in semantic analysis models, and also the relation of our approach with ideas formulated in [171 118j 
about quantum logic and semantic analysis. 



4.6 A Quantum Theory of Memory 

In |llj von Foerster develops a theory of memory and hints how a quantum mechanical formalism could be 
used to formalize the theory. Von Foerster was inspired by how quantum mechanics was introduced in biology. 
Genes, the carriers of heredity, are described as quantized states of complex molecules. Von Foerster introduces 
what he calls carriers of elementary impressions, which he calls mems, to stress the analogy with genes, and 
introduces the notion of impregnation as an archetypical activation of a carrier by an impression. Such an 
impregnation of a mem is formalized as a quantum mechanical excitation of one energy level of the mem to 
another energy level of this same mem, in analogy how this happens with a molecule. A molecule in an excited 
state spontaneously falls back to a lower energy state, and this process is called decay. The decay process of 
a mem in a high level energy state to a lower level energy state describes the phenomenon of forgetting. The 
introduction of the quantum mechanical mechanism of excitation and decay between different energy levels 
of a mem as the fundamental process of memory, respectively accounting for the learning and the forgetting 
process, is not developed further in von Foerster's publication. Von Foerster's conviction about the relevance 
of quantum mechanics to memory comes from his phenomenological study of the dynamics of the forgetting 
process. Although is not very explicit about this aspect, it can be inferred from his article that in his opinion 
the physical carrier of the mem is a molecule in the brain, such as a large protein, and that memory is hence 
stored within a micro-physical entity, entailing quantum structure because of its micro-physical nature. 
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The theory of concepts that we have elaborated is in some respects quite different from von Foerster's 
approach, but in other respects can dehver a possible theoretical background for this approach. Different in the 
sense that we do not believe that necessary there need to be a micro-physical carrier for the quantum structure 
identified in SCOP, ft is not excluded that the quantum structure is encrypted in a quite unique way in the 
brain, making use of the possibility to realize quantum structure in the macro- world, without the need of micro- 
physical entities 12 |H1 El EI E| ■ On the other hand, if micro-physical entities in the brain serve as carriers of 
quantum mechanical structure, our SCOP theory could provide specific information about this structure. We 
can also now clarify the notion of ground state. If a concept is not evoked in any specific kind of way, which is 
equivalent to it being under the influence of the bath of all type of contexts that can evoke it, we consider it 
to be in its ground state. Here we align our theory with von Foerster's idea and use the quantum mechanical 
processes of excitation and decay to point out specific influences of contexts on the state of a concept. If the 
concept 'pet', changes to the state pi under the influence of context ei, 'The pet is chewing a bone', then pi 
is an excited state with respect to the ground state p of 'pet'. The state pi will spontaneously decay to the 
ground state p. We 'forget' after a little while the influence of context ei, 'The pet is chewing a bone' on the 
concept 'pet' and consider 'pet' again in its ground state when a new context arrives that excites it again to 
another state. The process of excitation and de-excitation or decay, goes on in this way, and constitutes the 
basic dynamics of a concept in interaction with contexts. This is very much aligned with what von Foerster 
intuitively had in mind in 11 , and fits completely with a further quantum mechanical elaboration of our SCOP 
theory of concepts. We can go some steps further in this direction, which is certainly still speculative, but 
worth mentioning since it shows some of the possible perspectives that can be investigated in future research. 
If a molecule de-excites (or decays) and collapses to its ground state (or to a lower energy state) it sends out a 
photon exactly of the amount of energy that equals the difference between the energy of the ground state (the 
lower energy state) and the excited state. This restores the energy balance, and also makes the quantum process 
of de-excitation compatible with the second law of thermodynamics. Indeed, a lower energy state is a state 
with less entropy as compared to a higher energy state, and the ground state is the least entropy state. This 
means that the decrease of entropy by de-excitation has to be compensated, and this happens by the sending 
out of the photon that spreads out in space, and in this way increases the entropy of the compound entity 
molecule and photon. The entropy reasoning remains valid for the situation that we consider, independent of 
whether we suppose that the quantum structure in the mind is carried by micro-physical entities or not. This 
means that a de-excitation, e.g. the concept 'pet' that in state pi decays to the ground state p, should involve a 
process of spreading out of a conceptual entity related to 'pet'. Our speculation is that speech, apart from the 
more obvious role it plays in communication between different minds, also fulfills this role. This is probably the 
reason that if the de-excitation is huge and carries a big emotional energy, speech can function as a catharsis of 
this emotional energy, which would be why psychotherapy consisting of talking can function quite independent 
of the content of what is said. 

The global and speculative view that can be put forward is the following. The compound of all concepts 
relevant to a certain individual are stored in memory (a more correct way to say this would be: they are 
memory) and one specific state of mind of the individual will determine one specific state of this compound 
of concepts. This state of the compound of concepts is a hugely entangled state, but such that most of the 
time, the reduced states for each concept apart are the ground states. Any specific context will infiuence and 
change the state of mind of the individual, and hence also the entangled state of the compound of concepts, and 
hence also the ground states of some of the individual concepts. These are the concepts that we will identify as 
being evoked by this specific context. Most of these changes of state are just excitations that spontaneously will 
de-excite, such that all the individual concepts are in their ground states again. Form time to time however, 
a change of state will have consequences that change the structure of the entanglement, or even the structure 
of some of the concepts themselves. This are the times that the individual learns something new that will be 
remembered in his or her long term memory, and that will provoke a change of his or her world views. The 
energetic balance gets redefined when this happens, and a new stable entangled state of the compound of all 
concepts is introduced, giving rise to new ground states for the individual concepts (for example, 'pet' is not 
any longer what 'pet' was before, once one has his or hers own pet). This new situation, just as the earlier 
one, is again open to infiuences of contexts that introduce again the dynamics of excitation and spontaneous 
de-excitation. 
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5 Summary and Conclusions 



Von Foerster was inclined to push the formahzation of whatever happened to interest him at a given time as 
far as it could go using whatever tools did the job, in order to penetrate into the phenomenon more deeply. In 
this paper we take a non-operational step, embedding the SCOP in a more constrained structure, the complex 
Hilbert space, the mathematical space used as a basis of the quantum mechanical formalism. We have good 
reasons to do so. The generalized quantum formalisms entail the structure of a complete orthocomplemented 
lattice, and its concrete form, standard quantum mechanics, is formulated within a complex Hilbert space. The 
SCOP representation of a concept thereby makes strong gains in terms of calculation and prediction power, 
because it is formulated in terms of the much less abstract numerical space, the complex Hilbert space. 

Section 12 outlines the mathematics of a standard quantum mechanical model in a complex Hilbert space. 
It is not only the vector space structure of the Hilbert space that is important, but also the quantum way of 
using the Hilbert space. A state is described by a unit vector or a density operator, and a context or property 
by an orthogonal projection. The quantum formalism furthermore determines the formulas that describe the 
transition probabilities between states and the weights of the properties. It is by means of these probabilities 
and weights that we model the typicality values of exemplars and applicability values of properties. 

In Section |31 we embed the SCOP in a complex Hilbert space, and call the resulting model 'the quantum 
model of a concept', to distinguish it from the more abstract SCOP model. The quantum model is similar to a 
SCOP model, but it is more precise and powerful because it allows specific numerical predictions. We represented 
the exemplars, contexts, and states that were tested experimentally for the concept 'pet'. Each exemplar is 
represented as a state of the concept. The contexts, states and properties considered in the experiment are 
embedded in the complex Hilbert space, where contexts figure as orthogonal projections, states as unit vectors 
or density operators, and properties as orthogonal projections. The embedding is faithful in the sense that the 
predictions about frequency values of exemplars and applicability values of properties of the model coincide 
with the values yielded by the experiment f Section 13. 

Notice how the so-called 'pet fish problem' disappears in our formalism. The pet fish problem refers to the 
empirical result that a guppy is rated as a good example, not of the concept 'pet', nor of the concept 'fish', but 
of the conjunction 'pet fish'. This phenomenon, that the typicality of the conjunction is not a simple function 
of the typicality of its constituent, has come to be known as the 'guppy effect', and it cannot be predicted or 
explained by contemporary theories of concepts. In our experiment, and hence also in the quantum model, we 
have taken the context 'The pet is a fish' to be a context of the concept 'pet'. Both the experiment and the 
quantum model description show the guppy effect appearing in the state of 'pet' under the context 'The pet is 
a fish'. Subjects rate guppy as a good example of 'pet' under the context 'The pet is a fish', and not as a good 
example of 'pet', and the ratings are faithfully described by the quantum model (Section Of course this 

is not the real guppy effect, because we did not yet describe the combination of the concept 'pet' and 'fish'. 
Sectionals devoted to modeling concept combination. 

A specific procedure exists to describe the compound of two quantum entities. The mathematical structure 
that is used is the structure of the tensor product of the Hilbert spaces that are used to describe the two sub- 
entities. Section ITTl outlines the tensor product procedure for quantum entities. The tensor product of Hilbert 
spaces is a sophisticated structure. One of its curious properties is that it contains elements that are called 
non-product vectors. The states described in quantum mechanics by these non-product vectors of the tensor 
product of two Hilbert spaces are the so-called 'entangled quantum states'. They describe entanglement between 
two quantum entities when merging with each other to form a single compound. In the process of working on 
this quantum representation of concepts, we were amazed to find that it is these very non- products states that 
describe the most common combinations of concepts, and that more specifically a 'pet fish' is described by 
entangled states of the concepts 'pet' and 'fish'. This enables us to present a full description of the conceptual 
combination 'pet fish' and hence a solution to the pet fish problem in Section ITU There is more to the tensor 
product procedure than combining concepts. For example, it allow the modeling of combinations of concepts 
such as 'a pet and a fish', something completely different from 'pet fish'. In this case, product states are 
involved, which means that the combining of concepts by using the word 'and' does not entail entanglement 
(Section Ol). Finally, we show how our theory makes it possible to describe the combination of an arbitrary 
number of concepts, and work out the concrete example of the sentence 'The cat eats the food' fSection |4.5|I . 
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